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Executive Summary 


This is the eighteenth report by the National Center on Educational Outcomes (NCEO) that de- 
scribes how states publicly report online assessment data for students with disabilities in K-12 
schools in the United States. The 2015 reauthorization of the Elementary and Secondary Educa- 
tion Act (ESEA), as well as the Individuals with Disabilities Education Act (IDEA), continues to 
require states to disaggregate participation and performance data at the state level for all students 
and student subgroups. 


This report presents information on publicly reported participation and performance data for stu- 
dents with disabilities for the 50 regular states and the 11 unique states (American Samoa, Bureau 
of Indian Education, Commonwealth of Northern Mariana Islands, U.S. Department of Defense 
Education Activities, District of Columbia, Federated States of Micronesia, Guam, Palau, Puerto 
Rico, Republic of the Marshall Islands, and U.S. Virgin Islands). 


For the 2014-15 school year, 42 of the 61 states reported participation and performance data for 
students with disabilities for all general assessments, and 37 states reported these data for all alter- 
nate assessments based on alternate achievement standards (AA-AAS) that were used for the Title 
I accountability system. During this school year, many states were field-testing new assessments 
for either their general consortia assessments or alternate consortia assessments. Therefore, the 
reporting of assessment data was affected to some degree for this reporting cycle. Information 
about state assessments not used for Title I is also presented. 


Information on public reporting for English Learners (ELs) with disabilities is also included in 
this report. Only 3 states reported both participation and performance for ELs with disabilities for 
the general assessment. But, as in previous years, more states (N=12) reported these same data 
for ELs with disabilities on the AA-AAS. 


A majority of states reported some participation and performance data by individual grade and test 
for students with disabilities, though a few only reported these data by merged grades. Thirty-nine 
states reported student performance by achievement level, and 37 reported the percent proficient. 


The public reporting of data will continue to be an essential part of accountability systems. It is 
anticipated that states will continue to refine how they report data. The following recommendations 
are offered to states for the public reporting of disaggregated data for students with disabilities: 


1. Report participation and performance results for each assessment, content area, and grade level. 
2. Clearly label preliminary and final data with dates posted. 


3. Report participation with accommodations. 


4. Report participation percentages, disaggregated by grade. 


5. 


Make data accessible by attending carefully to the usability of formats, ease of finding 
information, and clarity of language. This includes not relying on a login code to access 
otherwise public data if confidentiality of individual students is not jeopardized. It also 
includes allowing users to see comparisons across grades rather than requiring users to 
generate individual data for each grade through custom report generators. The ideal is to 
offer both ways to access data. 


Provide reports in a format that is user-friendly for the general public rather than relying 
on technical reports to be the sole type of public reporting for student data. 
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Overview 


Under the 2015 reauthorization of the Elementary and Secondary Education Act (ESEA) and 
the continuation of the Individuals with Disabilities Education Act (IDEA) of 2004, the re- 
quirement continues for states that receive federal funding, including unique states, to report 
reading, mathematics, and science assessment data to the federal government for all students 
and student subgroups. States also are required to report these data to the general public. In the 
2014-15 school year many states were field-testing new assessments. Therefore, the reporting 
of assessment data was affected to some degree for this reporting cycle. States report these data 
online to the public in several ways, including as state report cards, state assessment reports, 
and customized data reports generated on state education websites (Albus, Lazarus, & Thurlow, 
2014; Lazarus, Albus, & Thurlow, 2016). 


The purpose of this report is to examine the extent to which states reported 2014-15 assessment 
data for students with disabilities “to the public with the same frequency and in the same detail 
as it reports on the assessment of nondisabled children,” as required by IDEA (Wiley, Thurlow, 
& Klein, 2005). It also describes how states report assessment participation and performance 
data to the public online. It summarizes these data for grades 4 and 8, and high school, with ad- 
ditional analyses that focus on average performance gaps across years. Additionally, the report 
summarizes the extent that states report participation and performance for English learners 
(ELs) with disabilities. It also examines the public reporting of accommodated student data for 
any student subgroup. 


The National Center on Educational Outcomes (NCEO) has tracked and analyzed public reporting 
for the students with disabilities subgroup for more than 15 years. In 2013-14, the total number 
of regular and unique states reporting disaggregated participation and performance data online 
for students with disabilities was 45 states (Lazarus, Albus, & Thurlow, 2016). This showed a 
decrease of 7 states from the 52 that reported these data in the previous year, 2012-13. Prior to 
2012-13, the number had been 49 states in 2011-12, 53 states in 2010-11, and 46 states in 2008- 
09 and 2007-08 (Albus, Lazarus & Thurlow, 2015; Albus & Thurlow, 2013; Thurlow, Bremer, 
& Albus, 2011; Albus, Thurlow, & Bremer, 2009). From 2002-03 to 2006-07, the number of 
states reporting participation and performance varied between 35 states and 39 states (Klein, 
Wiley, & Thurlow, 2006; Thurlow, Bremer, & Albus, 2008; Thurlow & Wiley, 2004; Thurlow, 
Wiley, & Bielinski, 2003; Wiley, Thurlow, & Klein, 2005; VanGetson & Thurlow, 2007). 


In 2013-14, the number of states that reported disaggregated participation and performance data 
for alternate assessments based on alternate achievement standards (AA-AAS) was 48. During 
the past 10 years, the number of states reporting for the AA-AAS had been as high as 52 in 
2012-13 and as low as 36 states in 2006-07 and 2007-08. 
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Method 


Between January and March 2016, state department of education websites were searched for 
publicly available reports that disaggregated participation and performance data for students 
with disabilities for the 2014-15 school year (i.e., state assessment reports, state report cards, 
customized report generators, and other report formats). The Annual Performance Report (APR) 
that states submit for federal accountability was not included in the analysis. 


States included in the search were the 50 “regular” states and the 11 “unique” states (American 
Samoa, Bureau of Indian Education, Commonwealth of Northern Mariana Islands, U.S. Depart- 
ment of Defense Education Activities, District of Columbia, Federated States of Micronesia, 
Guam, Palau, Puerto Rico, Republic of the Marshall Islands, and U.S. Virgin Islands). Partici- 
pation and performance data were collected, as well as information about how states reported 
those data. Data collection included all general and alternate assessments regardless of whether 
they were used for the Title I accountability system, including those assessments designed for 
bilingual students or ELs that were either general or alternate assessments. 


Individual state summary tables were prepared for verification using the information gathered 
about how states reported participation and performance. These verification materials were sent 
to state assessment directors and state directors of special education in July 2016. Twelve regu- 
lar states and one unique state responded to the verification request. After the verification was 
completed, the information on how and whether states reported participation and performance 
was summarized and additional information on participation rates and proficiency rates were 
analyzed. Double-checks of the data were completed for accuracy. See Appendix A for a sample 
email sent to the state directors and sample tables used in the verification process. 


Different types of assessments are given in states to serve one or more purposes. For example, 
some are given for accountability, while others are for diploma or graduation purposes. Some 
assessments may serve dual purposes within a state. Although the data collected for this report 
included all state level administered assessments found on state websites, this report focuses on 
how states publicly reported participation and performance data for students with disabilities 
on general assessments and AA-AAS. For this analysis, assessments were defined as follows: 


General assessment: Any assessment intended for students without disabilities and 
most students with disabilities that is designed to measure content area performance for 
Title I accountability or for exit or diploma purposes. General assessments may include 
end-of-course assessments for states that have them. 


Alternate assessment based on alternate achievement standards (AA-AAS): Any as- 
sessment intended for a very small percentage of students with disabilities who have 
significant cognitive disabilities to measure content area performance for Title I account- 
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ability, or for exit or diploma purposes. AA-AAS may include end-of-course assessments 
for states that have them. 


For the few states that administer additional types of alternate assessments, such as those using 
modified achievement standards or grade-level achievement standards, we provide only basic 
information on how they reported those data. 


Changes in policies for reporting data to the U.S. Department of Education over time, as well 
as adjustments in our own criteria, which narrowed after 2004-05, likely have affected the 
numbers of states counted as reporting on the general assessment and AA-AAS across years. 
APR data were not counted as publicly reported data after 2004-05 because these data were 
not necessarily reported with the same frequency and detail as public reporting for all students 
(see Thurlow et al., 2008). 


Results 


Results are presented in five sections in this report. The first section presents information about 
how states reported participation and performance data for students with disabilities for general 
and alternate assessments used for Title I accountability as well as those assessments not used for 
Title I accountability. It also examines how the same data were reported for ELs with disabilities. 
The second section describes the approaches states used to report participation data for general 
assessments. The third section describes the approaches states used to report performance data 
for general assessments. The fourth section presents select general assessment performance 
data at the elementary, middle school, and high school levels for reading and math, including 
information about average achievement gaps. The final section presents information about the 
public reporting of the use of accommodations on state assessments. 


How States Reported Participation and Performance Data 


General Assessment Data for Students with Disabilities 


Figure 1 shows that 42 of the 61 regular and unique states reported participation and perfor- 
mance for all general assessments used for Title I accountability for students with disabilities. 
Sixty-nine percent of states reported participation and performance for all general assessments, 
7 percent reported participation and performance for some general assessments, and 16 percent 
had no publicly reported data. Five percent (3 unique states) had no general assessments used 
for Title I. States with “no information found” differed from states without reported data found 
in that no assessment information or documents were found for general students in those states. 
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Figure 2 shows how each state reported the participation and performance of students with 
disabilities for the general assessment. The map shows that most states had full reporting of 
participation and performance for students with disabilities on general assessments used for 
Title I accountability. For details, see Table B-1 in Appendix B. 


Figure 1. Extent of Reporting of General Assessment Data for Students with Disabilities Used 
for Title | [N=61] 
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States also reported participation and performance for students with disabilities on general as- 
sessments not used for the Title I accountability system. Figure 3 shows that thirty-five states 
only had general assessments used for Title I. We examined reporting for the remaining 26 states 
Figure 3 shows that of the 24 states that had general assessments not used for Title I, 6 states 
reported participation and performance data for all tests, 1 reported these data for some tests, 
and 17 states did not publicly report data. 


Figure 4 presents participation and performance reporting by state for general assessments not 
used for Title I. This map shows that only a handful of states publicly reported participation and 
performance for these assessments. For details, see Table B-2 in Appendix B. 
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Figure 2. States Reporting 2014-15 Disaggregated Participation or Performance Data for 
Students with Disabilities on General State Assessments Used for Title I* 
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*Note: The figure does not include state APR data. A broad definition was used to determine whether a state 
had data. States were included if they had any data reported for the assessment (regardless of whether it 
was across all grades, by grade range, or for specific grades). 


Figure 3. Extent of Reporting of General Assessment Data for Students with Disabilities Not 
Used for Title | [N=61] 
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Figure 4. States Reporting 2014-15 Disaggregated Participation or Performance Data for 
Students with Disabilities on General Assessments Not Used for Title I* 
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*Note: States were included if they had any data reported for the assessment (regardless of whether it was 
across all grades, by grade range, or for specific grades). 


Alternate Assessment Based on Alternate Achievement Standards (AA-AAS) Data 
for Students with Disabilities 


This section presents the extent to which states reported participation and performance data 
for students with disabilities on alternate assessments based on alternate achievement stan- 
dards (AA-AAS) used for Title I. Figure 5 shows that 37 states reported both participation and 
performance data for all AA-AAS. This represents 60% of the states. Six states reported these 
data for some AA-AAS, and only one state reported performance only. The remaining states 
either had no AA-AAS used for Title I, had no publicly reported data found for AA-AAS, or 
no information was found about having an AA-AAS. 
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Figure 5. Extent of Reporting of AA-AAS Used for Title | [N=61] 
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Figure 6 shows the states that reported participation and performance data for AA-AAS used 
for Title I accountability. The map shows that most states (N=37) publicly reported participa- 
tion and performance for students with disabilities for these assessments. For details, see Table 
B-3 in Appendix. 


Figure 6. States Reporting 2014-15 Participation or Performance Data for Students with 
Disabilities on AA-AAS Used for Title I* 
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*Note: The figure does not include state APR data. A broad definition was used to determine whether a state 
had data. States were included if they had any data reported for the assessment (regardless of whether it 
was across all grades, by grade range, or for specific grades). 
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Assessment Data for ELs with Disabilities 


Like their peers, most ELs with disabilities take general assessments. Only a small percentage 
take an AA-AAS. Figure 7 shows that 54 states did not report participation or performance for 
ELs with disabilities on general assessments used for Title I. Only three states reported both 
participation and performance data for all general assessments used for Title I. This represents 
5% of the states. 


Figure 7. Extent of States Reporting Data for ELs with Disabilities on General Assessments 
Used for Title | [N=61] 
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Figure 8 presents the states that reported participation and performance data for ELs with dis- 
abilities on general assessments used for Title I. This map shows that very few states (N=3) 
publicly reported participation and performance data for ELs with disabilities on all general 
assessments. For details, see Table B-4 in Appendix B. 
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Figure 8. States Reporting 2014-15 Disaggregated Participation or Performance Data for ELs 
with Disabilities on General Assessments Used for Title | 
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*Note: The figure does not include state APR data. A broad definition was used to determine whether a state 
had data. States were included if they had any data reported for the assessment (regardless of whether it 
was across all grades, by grade range, or for specific grades). 


For the 24 states that had general assessments not used for Title I, only 1 state reported partici- 
pation and performance for ELs with disabilities (see B-5 in Appendix B for more details). The 
data are not graphed in this report. 


Figure 9 shows that 12 states, or 20% of states, publicly reported participation and performance 
on all AA-AAS for ELs with disabilities. Another 6 states publicly reported these data for some 
of their AA-AAS. Thirty-eight states did not publicly report data for ELs with disabilities who 
participated in an AA-AAS. 
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Figure 9. Extent of States Reporting AA-AAS Data for ELs with Disabilities for Title | [N=61] 
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Figure 10 shows the 18 states that reported participation and performance for ELs with disabili- 
ties on some or all of the AA-AAS used for Title I. For details, see Table B-6 in Appendix B. 


Figure 10. States Reporting 2014-15 Disaggregated Participation or Performance Data for ELs 
with Disabilities on AA-AAS Used for Title | 
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Alternate Assessment Based on Modified Achievement Standards (AA-MAS) Data 
for Students with Disabilities and ELs with Disabilities 


Alternate assessments based on modified achievement standards (AA-MAS) were an optional 
assessment used for Title I accountability until 2014-15, but a few states (n=3) continued to 
administer these assessments in their states. All three of the states with an AA-MAS in 2014-15 
reported participation and performance data for that year, either separately or noted that the AA- 
MAS data were merged with data for the general assessment. For ELs with disabilities, two of 
the three states reported participation and performance disaggregated for ELs with disabilities 
separate from other assessment data. For details, see Table B-7 in Appendix B. 


Alternate Assessment Based on Grade-level Achievement Standards (AA-GLAS) 
Data for students with Disabilities and ELs with Disabilities 


According to the publicly available data on state assessments found, two states had an Alternate 
Assessment based on Grade-Level Achievement Standards (AA-GLAS). Both of these states 
reported participation and performance data for students with disabilities, and one reported these 
data for ELs. For details see Table B-8 in Appendix B. 


Reporting Participation in 2014-15 


States reported participation data for assessments in several ways. Figure 11 shows the approaches 
taken by 46 states (of the total 61 regular and unique states) that reported participation data. 
Thirty-seven states publicly reported the number of students tested and 28 states reported the 
percent of students participating in general assessments for the Title I accountability system. 
Only 6 states reported the percent of students with no scores; 11 states presented the number 
of students with no scores. Figure 11 includes data for states that used any method of report- 
ing participation data (i.e., by grade and test, by merging grades and tests, by grade with tests 
merged, and by test with grades merged). For additional details see Table B-9 in Appendix B. 
For details about AA-AAS participation see Table B-10 in Appendix B. 


Figure 12 shows the participation rates for grade 8 mathematics for those states with this infor- 
mation reported by grade and test. Of the 28 states that reported on participation rates, 10 states 
reported these data with denominators based on students with disabilities in grade 8, an approach 
that could be compared (e.g., does not include rates of entire population or rates reported by 
accommodated status). See Appendix Table B-11 for the state abbreviation key. 


NCEO 11 


Figure 11. States Reporting Participation by Students with Disabilities for General 
Assessments Used for Title | Accountability in 2014-15 
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States reported performance data in a variety of ways, such as the number or percent in each 
achievement level, percent proficient or not proficient, average scaled scores, or percentiles, 
for example. Figure 13 shows that the most common way that states reported performance 
data was by percent in each achievement level (n= 39). The next most frequent way was by 
percent proficient. The “other” category includes states that reported scaled scores, percentiles, 
or other types of scores. This figure includes data from states that used any method of report- 
ing participation data (i.e., by grade and test, by merging grades and tests, by grade with tests 
merged, and by test with grades merged). Also, states could be counted more than once for the 
type of data reported, so the number does not total to 61 states. For additional details see Table 
B-12 in Appendix B. For details about AA-AAS performance see Table B-13 in the Appendix. 
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Figure 13. Number of States Reporting Performance in Different Ways for Students with 
Disabilities in 2014-15 General Assessments Used for Title | 
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Selected Results of General Assessment Performance for Students 
with Disabilities 


In this section the performance of students with and without Individualized Education Programs 
(IEPs) is compared for states that reported data for each of three representative grades (e.g., 
Grade 4, Grade 8, and high school) by the content areas of reading and mathematics. Figures 14 
to 19 show the gaps between students with disabilities and a comparison peer group, with the 
solid line representing the gap between student groups. The comparison peer group varied by 
state, with some states reporting the performance of students without IEPs and others reporting 
the total student population that included students with IEPs. 


Because the gaps were affected by whether a state used a comparison group of all students or 
students without disabilities, we indicate the group used by each state on the horizontal axis 
with an A if the state included all students and an O if the comparison group for the state was 
students who do not have IEPs. The students without IEPs group may include students with 504 
plans depending on how a state defined its population. Therefore, the gaps reported here could 
also vary based on how those states reported their performance data. 


States with an AA-MAS are indicated in the figures with a box around the percent proficient 
number for the comparison group, and shaded boxes indicate states that merged AA-MAS per- 
formance with general assessment data. See Appendix Table B-11 for the state abbreviation key. 


Elementary School 


Figures 14 and 15 present the results for Grade 4. Across the states, the smallest gap between 
students with IEPs and the comparison group for elementary reading was 16 percentage points, 
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and the largest gap was 47 percentage points. For elementary mathematics, the gap ranged from 


11 percentage points to 40 percentage points. 


Figure 14. Percent Proficient for Elementary Reading* 
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Legend: Heavy Solid Bar= Students with IEPs percent proficient 
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Narrow Solid Line = Gap between students with IEPs and the comparison group 


Box= State has an AA-MAS 


Shaded Box =State reported AA-MAS merged with general assessment 


A= All students (n=16 states) 
O=Students without IEPs (n=26 states) 


*Note: N=42 of 61 states [includes unique states]; No data=19 states. 
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Figure 15. Percent Proficient Elementary Mathematics* 
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Legend: 


Heavy Solid Bar= Students with IEPs percent proficient 

Narrow Solid Line = Gap between students with IEPs and the comparison group 
Box= State has an AA-MAS 

Shaded Box =State reported AA-MAS merged with general assessment 

A= All students (n=16 states) 

O=Students without IEPs (n=26 states) 


*Note: N=42 of 61 states [includes unique states]; No data =19 states 
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Middle School 


Figures 16 and 17 show the performance gaps for Grade 8 reading and mathematics. At the 
middle school level, for reading, gaps ranged from 18 percentage points to 54 percentage points. 
For mathematics, the gaps ranged from 11 percentage points to 48 percentage points. 


Figure 16. Percent Proficient for Middle School Reading* 
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Legend: Heavy Solid Bar= Students with IEPs percent proficient 
Narrow Solid Line = Gap between students with IEPs and the comparison group 
Box= State has an AA-MAS 
Shaded Box =State reported AA-MAS merged with general assessment 
A= All students (n=17 states) 
O=Students without IEPs (n=25 states) 


*Note: N=42 of 61 states [includes unique states]; No data=19 states 
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Figure 17. Percent Proficient Middle School Mathematics* 
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Heavy Solid Bar= Students with IEPs percent proficient 

Narrow Solid Line = Gap between students with IEPs and the comparison group 
Box= State has an AA-MAS 

Shaded Box =State reported AA-MAS merged with general assessment 

A= All students (n=16 states) 

O=Students without IEPs (n=26 states) 


Note: N=42 of 61 states [includes unique states]; No data=19 states 
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High School 


Figures 18 and 19 show gaps for high school reading and mathematics. Grade 10 was used when 
more than one grade was tested. For reading, the gaps ranged from 21 percentage points to 54 
percentage points; for mathematics the range is from 3 percentage points to 49 percentage points. 


Figure 18. Percent Proficient for High School Reading* 
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Legend: Heavy Solid Bar= Students with IEPs percent proficient 
Narrow Solid Line = Gap between students with IEPs and the comparison group 
Box= State has an AA-MAS 
Shaded Box =State reported AA-MAS merged with general assessment 
A= All students (n=15 states) 
O=Students without IEPs (n=27 states 


*Note: N=43 of 61 states [includes unique states]; No data= 18 states 
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Figure 19. Percent Proficient for High School Mathematics* 
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Legend: Heavy Solid Bar= Students with IEPs percent proficient 


Narrow Solid Line = Gap between students with IEPs and the comparison group 
Box= State has an AA-MAS 

Shaded Box =State reported AA-MAS merged with general assessment 

A= All students (n=16 states) 

O=Students without IEPs (n=27 states) 


*Note: N=43 of 61 states [includes unique states]; No data= 18 states 


Average Gap Summaries for Students With and Without IEPs by Content Area and 
School Level 


Table 1 summarizes the average achievement gaps between students with IEPs and the com- 
parison peer group. The comparison peer group may or may not include students with IEPs 
depending on the reporting practices of each state. The table presents gaps by content areas 
and school levels across select years. There are limitations to this analysis in that the number 
of states with data fluctuates each year and the assessments a state uses may change over time. 
Further, there are differences in how states report percent proficient for students with IEPs. For 
example, in some cases, states reported AA-MAS performance merged with general assessment 
performance. 


Table 1 shows the mean gaps for every other year from 2006-07 through 2014-15. The average 
gap 1s presented with the number of states with data for each year. The gap sizes changed only 
slightly across grades and content areas until the present year, where math average gaps were 
much lower at the middle and high school levels compared to previous years, even though the 
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number of states changed only slightly. For example, for elementary reading, the mean gap was 
31 in 2006-07 and 2008-09, 34 in 2010-11, 35 in 2012-13, and 32 in 2014-15. But for middle 
and high school math, the gap ranged from 37 to 40 from 2006-07 to 2013-14, but was 28 or 
29 in 2014-15. 


Table 1. Gaps for Students with IEPs and Comparison Peer Group on General Assessments: 


Biannually from 2006-07 to 2014-15 


Mean Gaps for All States with Data’ 
2006-07 2008-09 2010-11 2012-13 2014-15 

Grade Number Number Number Number Number 
Ranges Gap | of States} Gap |ofStates| Gap | of States| Gap | of States; Gap | of States 
Elementary 35 32 

Reading 31 47 31 45 34 45 (34) | 45 (48) | (32) | 41 (42) 
Middle 

School 41 38 

Reading 40 47 40 46 41 45 (41) | 45 (48) | (38) | 41 (42) 
High School 39 37 

Reading 40 46 40 44 40 45 (38) | 46 (49) | (36) | 41 (42) 
Elementary 32 29 

Math 29 47 28 46 30 45 (32) | 45 (48) | (28) | 41 (42) 
Middle 40 29 

School Math 40 47 38 46 40 42 (39) | 45 (48) | (29) | 41 (42) 
High School 37 28 

Math 38 44 37 44 40 43 (36) | 46 (49) | (28) | 42 (43) 


' Data in parentheses include the unique states. Data including the unique states were available only for 2012-13 and 
2013-14. Prior analyses did not include the unique states. 


Accommodations Data on Students with Disabilities 


Figure 20 presents the number of regular and unique states that reported data for students with 
disabilities using accommodations on the general assessment, by whether the state reported 
participation, performance, or both. Only 20 states had any accommodations data reported, with 
12 states reporting participation and performance, 7 states reporting participation only, and 1 
state reporting performance only. See Appendix B-14 for specific state information shown in 
Figure 20. 
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Figure 20. Number of States Reporting Accommodations Data 
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Summary and Conclusions=== 


Extent of Public Reporting for Students with Disabilities 


Thirty-three regular states, and two unique states, reported participation and performance for all 
general assessments and alternate assessments based on alternate achievement standards (AA- 
AAS) used for Title I accountability purposes in 2014-15. Forty-two of the 61 states reported 
both participation and performance for all general assessments and 37 reported similar data for 
the AA-AAS. 


Of the 24 states with general assessments not used for Title I, only 6 states reported participa- 
tion and performance and 1 additional state reported performance only. This is almost exactly 
the same number that reported these data compared to the prior year, where the same number 
reported participation and performance, but two states reported either participation or perfor- 
mance only, for all general assessments not used for Title I. 


Extent of Public Reporting for ELs with Disabilities 


The number of states that reported both participation and performance for ELs with disabilities 
decreased to three states from seven in 2013-14. For AA-AAS, 12 states reported participation 
and performance. This number dropped significantly from the 21 states that reported in the 
previous two years. It might be expected that more states would have reported disaggregated 
data for this assessment, given the requirements of ESEA to report by subgroup for each state 
assessment. One state reported participation and performance for ELs on general assessments 
not used for Title I, the same as last year. 
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How Data Are Reported 


Among the regular states, the most common approaches for communicating participation and 
performance on general assessments and AA-AAS remained the same in 2008-09, and 2010- 
11 through 2014-15. For participation in 2014-15, the most common way to report for regular 
and unique states on general assessments was in terms of the number assessed (37 states) and 
percent participating (28 states). For performance, the most common way for regular and unique 
states to report on general assessments was the percent of students in each achievement level (39 
states) followed by percent proficient (37 states). Because states used different methods to report 
(e.g., merging assessments, grades, or both), the numerators and denominators used to report 
participation and performance data varied significantly across states. Adding to the complexity 
is the fact that some states report public data using multiple methods across participation and 
performance, thus increasing the difficulty of making interpretations about participation and 
performance. 


As in previous reports, this report presented participation rates for middle school mathematics 
as an example of how states report participation rates for students with disabilities. Ten states 
reported participation rates by grade in a way that would be comparable to include in a graph. 
Additional states provided numbers that would possibly allow for rates to be calculated. However, 
in recent years participation data have become less transparent, in part because states that had 
alternates based on modified achievement standards (AA-MAS) or alternates based on grade- 
level achievement standards sometimes opted to merge those data with the general assessment 
data in public reporting for participation and performance. Because the AA-MAS has been 
phased out of most states that used them, it is anticipated that these data should become more 
transparent in future years. Another reason that rates may be less straightforward is that states 
vary in the denominators used to calculate rates. 


Achievement Gaps 


The achievement gaps between students with and without IEPs in reading and mathematics 
persist. This report presented average achievement gaps for elementary, middle school, and 
high school levels. As in past reports, generally speaking, there were smaller overall gaps in 
elementary reading and mathematics than at the middle school and high school levels. There 
were a few states that did not fit this generalization. For example, one state had a gap of 3 per- 
centage points in high school mathematics. At the middle school and high school levels, for 
reading and mathematics, the average gaps across states spanned from 28 percentage points to 
38 percentage points for 2014-15. 


There was a noticeable decrease in the average gap for middle and high school mathematics 
from previous years. Due to the many factors underlying achievement gaps, the reason for these 
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specific changes in 2014-15 is not clear. Many states were field-testing or adopting new assess- 
ments in this time frame, which may have affected the publicly reported data, but there may be 
other factors also contributing to this shift in average gaps. In general, the different methods used 
to report data among states influences the achievement gaps reported. As would be expected, 
those states with “‘all students” as the comparison group tended to show smaller gaps compared 
to states using students without IEPs” as the comparison group. Other factors that influence the 
size of achievement gaps include whether a state had an AA-MAS, the percentage of students 
taking an AA-MAS in lieu of the general assessment, and how these data are reported. 


Recommendations for Reporting 


Many states have transitioned to new assessments based on College- and Career-Ready Stan- 
dards, and states continue to shift in what assessments they are using. Given this backdrop, and 
flexibility in different approaches for accountability reporting, there may be further changes in 
how participation and performance data for students with disabilities and ELs with disabilities 
are reported. In the intervening time, it is important that states continue to publicly report data 
for students with disabilities with the same frequency and detail as for other students. As in the 
previous report (Lazarus, Albus, & Thurlow, 2016), the following recommendations are offered 
to states for public reporting of disaggregated data for students with disabilities: 


1. Report participation and performance results for each assessment, content area, and grade 
level. 


2. Clearly label preliminary and final data with dates posted. 
3. Report participation with accommodations. 
4. Report participation percentages, disaggregated by grade. 


5. Make data accessible by attending carefully to the usability of formats, ease of finding 
information, and clarity of language. This includes not relying on a login code to access 
otherwise public data if confidentiality of individual students is not jeopardized. It also 
includes allowing users to see comparisons across grades rather than requiring users to 
generate individual data for each grade through custom report generators. The ideal is to 
offer both ways to access data. 


6. Provide reports in a format that is user-friendly for the general public rather than relying on 
technical reports to be the sole type of public reporting for student data. 
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Appendix A 


Material Used for the Verification Process 


1. Example letter to Assessment Director and Special Education Director. 


The National Center on Educational Outcomes is examining states’ public reports for the 2014-2015 
school year assessment results. Our goal is to: 


(a) identify all components of each state’s testing system; 


(b) determine whether each state reports disaggregated test results for students with disabili- 
ties and English language learners (ELLs) with disabilities; and 


(c) describe the way participation and performance information is presented. 


As in previous years, we are looking at assessment department reports and the equivalent of report 
cards used for Title I. 


We have reviewed your Web site for this information and have enclosed tables summarizing that re- 
view. Please verify all included information. Specifically, please return the tables that we have 
attached, noting your changes to them. Also, if there is additional publicly reported informa- 
tion available for your state, please provide us with the public document and/or website that 
contains the information. Address your responses to Deb Albus via email albusOO1@umn.edu. 


If you have any questions about our request, please email Deb Albus or call at (612) 626-0323. 
Please respond by August 1, 2016. 


Thank you for taking the time to provide this information. 
Martha Thurlow, Director NCEO 


Deb Albus, Research Fellow, NCEO 


Alabama 


1. Reporting in State Assessments Summary 
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Please check the information below for accuracy and make edits as needed. 


Assessments Grade Subject Areas Disaggregated Data Used 
Special Education | ELLs with Disabili- | _ fr 
ties Title | 
Partici- | Perform- | Partici- | Perform- 
pation ance pation ance 
ACT Aspire 3-8, 10 | Reading, Math Yes Yes No No Yes 
The ACT College 11 English, Math, Reading, No No No No No 
Readiness Test Science 
Alabama Science | 5,7 Science Yes Yes No No Yes 
Alabama Alternate | 3-8, Reading, Math Science Yes Yes Yes Yes Yes 
Assessment 10-11. | (5,7) 
ACT Plan 10 English, Math, Science Yes Yes No No Yes 


2. Reporting on Students with Disabilities 


How was participation and performance reported on the Title | assessments (general and alternate 
based on alternate achievement standards (AA-AAS))? 


Note Yes, No, or NA (not applicable). If AA-AAS is merged with general, repeat the answer for general. 


Number Enrolled/ Eligible to be | No No Percent Proficient No No 
Tested 


Number of Students Tested Percent Proficient Derived 
Number of Students Not Tested Percent Not Proficient 
Percent Participating in Test Number Proficient 


Percent of Students Not Tested Number Not Proficient 


Number of Students with Scores | No No Number by Achievement No No 
Level 
Number of Students with No | No No Percent by Achievement Yes Yes 
scores Level 
Percent of Students with No | No No Percentile Rank No No 
Scores 


3. If your state had an alternate based on modified achievement standards in 2014, how was 
participation reported? Not applicable 


Accommodated Status Reporting 


4. Did your state report accommodated status data for any population? List assessments or note NA, 
then answer Yes or No. Please note the report name or provide link if different from below. 
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List assessment and describe reporting Reported | Reported 
Participa- | Perfor- 
tion? mance? 


On what | ACT Aspire and Alternate Assessment 
assessment(s)? | Reporting Number of Students Tested by accommodated 
and non-accommodated and percent in each perfor- 
mance level 


Report name/Link to report/attach: 2013-2014 Participation and Performance of Students with IEPs 
Taking Assessments With and Without Accommodations 


Participation and Performance Data for Students with Disabilities, English Language Profi- 
ciency Assessment (ELPA) 


5. Disaggregated Data for the English Language Proficiency Assessment 


ELPA Name Grade | Reports Data for | Disaggregated Data for ELLs with Disabili- 
All Students ties 


Participation Performance 


ACCESS for K-12 No No No 
ELLs 
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Table B-11. State Abbreviation Key 


State 


Abbreviation 


NCEO 


AL 


State’s Full Name State 

Abbreviation 
Alabama MO 
Alaska NV 
Arkansas NH 
Arizona NJ 
California NM 
Colorado NY 
Connecticut ND 
Delaware OH 
Florida OK 
Georgia OR 
Hawaii PA 
Idaho RI 
Illinois SC 
lowa SD 
Kansas TN 
Kentucky TX 
Louisiana UT 
Maine VT 
Maryland VA 
Massachusetts WA 
Michigan WV 
Minnesota WI 
Mississippi WY 


State’s Full Name 


Missouri 
Nevada 

New Hampshire 
New Jersey 
New Mexico 
New York 
North Dakota 
Ohio 
Oklahoma 
Oregon 
Pennsylvania 
Rhode Island 
South Carolina 
South Dakota 
Tennessee 
Texas 

Utah 
Vermont 
Virginia 
Washington 
West Virginia 
Wisconsin 
Wyoming 
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